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(57) Abstract 

Methods and apparatus automatically detect alertness in humans by monitoring and analyzing 
brain wave signals (13). Steps include: acquiring the brain waves (EEC or MEG) data from the subject, 
digitizing the data, separating arti&ct data from raw data, and comparing trends in F-data alertness 
indicators, {xoviding notification of inadequate alertness. 
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METHOD AND APPARATUS FOR EXTRACTION OF LOW-FREQUENCY 
ARTIFACTS FROM BRAIN WAVES FOR ALERTNESS DETECTION 

The United States Government has rights in this invention pursuant to contract no. 
DE-AC05-84OR21400 between the United Sutes Department of Energy and Lockheed 
Martin Energy Systems, Inc. 

FIELD OF THE INVENTION 

The present invention relates to the use of human electroencephalogram (BEG) data 
and magnetoencephalogram (MEG) data for detecting alertness, and more particularly to the 
use of a zero-phase filter for separating artifact data fi-om raw data to enable the artifact data 
to be examined for indicators of fatigue and/or drowsiness. 

CROSS-REFERENCE TO RELATED APPUCATTONS 
This invention is related to Docket No. 1742-X Epileptic Seizure Detection by Nck)- 
iinear Methods by Lee M. Hively, Ned E. Clapp, C. Stuart Daw, and William F. Lawldns and 
to Docket No. 1743-X Epilq)tic Seizure Prediction by Non-linear Methods by Lee M. 
Hively, Ned E. Clapp, C. Stuart Daw, and William F. Lawkins, both of vAdch are filed on even 
date herewith, and both of which are as^gned to the same entity.. 

BACKGROUND OF TEE INVENTION 
It has long been accepted that in humans, blinking of the eyes serves to deanse and 
lubricate the corneal surface, and that the rate of blinking and other measures of blinking could 
be attributed to enviroiunental conditions (such as humidity and particulates in the air). It has 
also been postulated by investigators that blinking is strongly influenced by other factors such 
as £itigue and drowsiness, and may be monitored to provide some indication of alertness, 
which is used herein to mean the absence of fatigue and drowsiness. 

The ability to measure alertness, or to detect the absence of alertness or presence of 
fatigue or drowsiness is desired. Many work assignments require a high level of alertness, 
often in environments not condudve to nuuntaining alertness. Examples of these are: nuclear 
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reactor operators, aircraft pUots and other operators of conq)lex equipment, air traffic 
controllers and others whost work environments provide little visual stimulus of a non- 
monotonous nature. Often consequences of l^ses in alertness in these conditions can be 
grave, involving a high degree of hazard to Bfe and property. It is this connection that has led 
the inventors to develop tMs method and apparatus for detection of alertness. 

OBJECTS OF THE INVENTION 

Accordingly, it is an object of the present invention to pro\dde new and improved 
methods and apparatus for extraction of low-frequency artifacu from brain waves to permit 
use of the artifact date for detecting alertness in subjects. 

It is a second object to provide a new and improved zero-phase filter for use in 
separating artifact brain wave data from raw brain wave data to permit using the artifact data 
to detect alertness in subjects. 

Further and other objects of the present invention wiU become apparent from the 

description contuned herdn. 

SUMMARY OF THE INVENTION 
In accordance with one aspect of the present invention, the foregoing objects are 
achieved by a method for automaticaUy extracting low-frequency artifacts from brain waves 
which comprises the steps of: providing at least one charaiel of raw brain wave data, called e- 
data, selected from the group consisting of electroencephalogram data and 
magnetoencephalogram data; and separating artifiict data. caUed f-data, from the e-data whUe 
preventing phase distortions in the data, by passing the e-data through a zero-phase quadratic 
filter which provides an output off-data, whereby the f-data may be fiirther analyzed to detect 
alertness. 

In accordance with a second aspect of the present invention, the foregoing and other 
objects are achieved by apparatus for automaticaUy detecting alertness in a subject which 
comprises: data provision means for providing at least one channel of the subject's raw brain 
wave data. caUed e-data. selected from the group consisting of electroencephalogram dau and 
magnetoencephalogram data; and separation means for separating artifact data, called f-data. 
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from the e-data while preventing phase distortions in the data, said separation means 
comprising a zero*phase quadratic filter providing an output of f«data, said separation means 
conununicably connected to said data provision means, wherd^ the f-data may be further 
analyzed to detect alertness. 

In accordance with a third aspect of the present invention, the foregoing and other 
objects are achieved by a zero-phase filter for separating artifiict brain wave data from raw 
brain wave data selected from the group consisting of electroencephalogram data and 
magnetoencephalogram data comprises a zero-phase quadratic filter wherein the data is fit to 
a quadratic equation that takes the form 

Fi = F(ti) = a,(ti-g^ + a2(ti-0 + a3 = a,Ti^ + a2Ti + a3 

wheran = C At is the time at the central point, and T| = - t,. ; this approximation is 
fitted to the data, by minimizing the sum of squares of the differences between the quadratic 
equation, F(t). and the raw electroencephalogram data, e(tX corresponding to the miiumum in 
the function 

L = S[F(ti).e(ti)r = L[(a,Ti^ + a,Ti + a,)-e^^ ; 

i = o-D i « HI 

the minimum in L is found from the condition dL/da^ = 0, for k = { 1, 2, 3 }, fomung 

three simultaneous linear equations in three unknowns; the window-averaged artifact (F J is 

given by the fitted value of the central point, = F(0) = Si^l the sums over odd powers of 

Tj are zero and qrmmetric sums over even powers of Tj (over i from -n to +n) can be 

converted to sums from 1 to n with Tj = i At, yielding a window-averaged solution for the 
artifact agnal 

3(3n^ + 3n.lXSieiJ-15(Si?eHj 

Fe = — ;and 

(4n^ + 4n-3)(2n+l) 

the filter is embodied a programmed integrated circuit semiconductor chip. 
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BRIEF DESCRIPTION OF THE DRAWINGS 
In the drawings: 

Fig. 1 is a block diagram showing how brain wave data is obtained fiom the subject, 
digitized, processed, and analyzed to detect alertness, drowsiness, or fatigue. 11 shows the 
patient's head, looking from above. 13 shows EEG electrode positions on the patient's scalp. 
15 shows a measure of alertness, drowsiness, or fitigue. 

Fig. 2 shows standard EEG electrode positions on a patienf s scalp for the bipolar 
montage, looking from above. €13 labels tht position where the channel 13 data, which is 

used in this work ori^nates. 

Fig. 3 shows sample plots of EEG data, and compares raw (e-data) with artifact- 
filtered (g-data). 

For a better understanding of the present invention, together with other and further 
objects, advantages «td capabilities thereof; reference is made to the foBowing disclosure and 
appended claims in connection with the above-described drawings. 

DFTAILED DESCRIPTION OF TBE INVENTION 
This invention has been developed as an adjunct to ti»e development of methods and 
apparatus for detection and prediction of epileptic seizures by non-linear methods. In that 
work, it was necessary to develop methods and apparatus for separating certain brain-wave 
(EEGorMEOdatafromotiierdatainordertodetectand/orpredictseizures. Thedatathat 

was separated was primarily " artifact" data, that is data resuWng from eye bBnks. chewing, and 
other movements not related to brain activity. The separation of these types of data had to be 
done without disturbing phase relationships witiun the data in order for the sdzura detection 
and prediction methods to be effective. 

In the work described herein, sixteen channels of EEG data were analyzed. The data 
were retrieved in analog fonn from VHS tapes and converted to digital form with 12-bit 
precision, giving an integer between -2048 and +2047. The digital sampUng rate (Q was 5 12 
Hz over a total sample time of 10-23 minutes, corresponding to a total dataset size of 9.8-22.5 
megabytes in binary form. 

4 
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It is acknowledged that to detect drowsiness or &tigue» or to detect alertness, as it 
occurs, the brain wave data used would not be recorded data, but would be currently* 
occurring data. Tlus data would be taken from the patient to the apparatus directly using 
standard EEG or MEG methods, or other more convenient convenient means such as 
eyeglasses, a hat, headband, or the like that would comprise the means for picking up the 
signal from the subject. The eyeglasses, hat, headband, or the like would be communicably 
connected directly to the means for separating the arti&ct data from the raw data, or 
mdirectly by transmitting the data to an apparatus remote from the patient by means such as 
telephone, radio, or other communications means well known to the skilled artisan. 

Accordingly, a zero*phase quadratic filter was developed for use in separating the 
"clean" brain wave data from the artifact data. Now, in this invention a second use for the 
filter is found, and the artifact data is put to new use in a method and apparatus for alertness 
detection. 

The method is accomplished by monitoring brain waves as recorded in standard digital 
electroencephalogram (EEG) data or magnetoencephalogram (MEG) data, sqiarating &om 
the raw data artifact data, including indications of eye blinks, twitches, movements of the head 
and jaw, etc., analyzing the artifact data for patterns of eye blinks that indicate fatigue or 
drowsiness, detecting indications of fatigue or drowsiness, and providing an indication of 
fatigue to the subject or other person or data system. 

In the course of developing methods and apparatus for using raw EEG or MEG data, 
hereinafter called e-data, to detect and predict epileptic seizures, it was necessary for the 
inventors to separate artifact data fiiom raw data in order to process the arti&ct-free data and 
detect or predict epileptic seizure. The artifact data is used in the present invention for 
alertness detection. In order to separate the artifact data from the raw data while preserving 
phase relationships and characteristics in both the artifact-free data and the arti&ct data, it was 
necessary to develop a zero-phase filter and method for using the filter. 

John A. Stem, Donna Boyer, and David Schroeder, in Human Factors, 1994, 36(2), pp 
28S-297, indicates that researchers "have been less concerned mth physical and environmental 
&ctors responsible for the act of blinking and more concerned with psychologcal or 
behavioral variables that may affect blink rate. One such &ctor is fatigue, a term difficult to 

5 
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define. espedaUy if one prefaces it with the tenn mental. Physical fetigue is generally defined 
vath respea to a reduction in capacity to perform physical work as a fimction of immediately 
preceding physical effort Mental fioigue is inferred firom decrements in performance on tasks 
requiring alertness and the manipulation and retrieval of information stored in memory." Stem 
et al. suggest that mental fatigue is physiologicaUy measurable, and fiirther single out the eye 
blink as a major reflector of mental fetigue processes. 

Stem et al. also note that it is their "contention that the application of electrodes for 
the recording of variables of interest is acceptable in laboratory investigations but is. for a 
variety of reasons, not possible in rcal-world attempts at monitoring attentional processes." 

Blmk Rate: APossible Measure of Fatigue, filiman Facton. 1994. 36(2), pages 285- 
297 by John A. Stem. Donna Boyer. and David Schroedcr is hereby incorporated by 

reference. , r 

Because the raw EEG data used in this study was taken from only one channel of a 
standard sfacteen^el standard EEG data set. this invention demonstrates that Stem et al 
contend im«lidly that -the appUcation of electrodes for the recording of variables of mterest « 
acceptable in laboratory investigations but is. for a variety of reasons, not possible m real- 
worid attempts at monitoring attentional processes.- Data can be easily taken by one or a few 
dectrodes mounted in eyeglasses, hat. headband or oti^ereasily-worn or eas^^^ 

on the head, contacting the scalp. From the electrode or electrodes, data is transmitted to the 
apparatuswluchdigitizes,filters,andanalyzesthedauandprovidesnotificati^^ 

EEG and MEG brain wave data contains not only signals associated with bram acuvity, 
but also has artifacts (e.g., eye blinks, musde twitches, chewing, etc.) that obs«^ 
v«ive signal. In developing methods and apparatus for epUeptic seizure detection and 
prediction by non-Unear metiiods. a novel zero-phase filter was developed to remove low- 
frequencyartifacts. based onti^efollowingcriterion. A zero-phase-sltifl filter was needed to 
prevent phase distortions when subtracting ti.e filter output (the "artifect" signal) from the 
EEG signal to yieU an undistorted artifact-filtered or artifect-free signal, because phase 
relationshipsaremostimportantmthesubsequentnonlinearanalysis. Standard high-pass fiher 
techniquesdonotmeettiuscriterion. A computationally fi^t. simple, low-frequency s.gnal 
foUowerwasnecessarytoeventuallyapplythefilterinreal.ornear.realtime. Consequemly. 
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quadratic regression analysis was used, with the same number of data samples on either side of 
a central point. Other standard digital filtering methods (45) could not meet this requirement. 

The zero-phase filter method, v/bidti could be embodied in an integrated-drcuit chip, is 
as follows. For a specific EEG channel, the signal (e) at time (t) is sampled at regular intervals 
(tj =i At) to yield a set of time serial data = e(ti). We selected a filter-window length of 
2n + 1 points fi-om the time series, where n is the number of points on either side of the 
central point (e^ as indicated in the sequence below. 

central point 
I 

n points n points 



The data was fitted to a quadratic equation that takes the form 

Fi = F(ti) = ai(ti.g^ + a,(ti.g + a3 = a,Ti^ + a,T, + a3 

Here. t,. = C At is the time at the central point, and = t^ - t^. This approximation is 
fitted to the data, by minimiang the sum of squares of the differences between the quadratic 
equation, F(t), and the raw EEG data, e(t), corresponding to the minimum in the foUowing 
function: 



L = S m) - tm' = S [(a, T,^ + 8^1^ + a3) - (1) 



I s 0-n t s -D 



The minimum in L is found fi-om the condition dUdSiy, = 0, for k = {1,2, 3 } , 
forming three simultaneous linear equations in three unknowns. The window-averaged artifact 
(FJ is given by the fitted value of the central point, F^. = F(0) = 2iy Note that the sums 
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over odd powers of T5 are zero and that synunetric sums over even powers of (over i 
from -n to +n) can be converted to sums from 1 to n with Tj = i At yielding a window- 
averaged solution for the arti&ct signal: 

3(3n^ + 3n-lXSieiJ-15(Sii^eiJ (2) 



(4n* + 4n-3)(2n+l) 



Here. Sj indicates the sum over i from -n to +n. Sums over even powers of "i" were 
expUdfly evaluated with standard formulae (36). The effort to evaluate Fe can be reduced 
substamially by computing the sums initially from Eq. 2 (at C = n + 1). and then using the 
foUovwig recursions thereafter: 



S i enc, - n e^, + (n + 1 ) + S 



(3) 



(4) 



(5) 



i=*-n 
i»-n 



The right-hand sides of Eqs. 3-5 only mvolve the sums previously computed. 
Application of Eqs. 2-5 to the N-point set of original time serial EEG data (C^) yields an 
artifact datasetC^ OF f-data) with (N.2n) points that contains the low frequency artifiu. 

signal. 
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The filter-window length (n=128) corresponds to a frequency of 2.0 Hz [—512 
Hz/(2n +1 )]. Figure 3a shows an example of the application of this method, with (raw) e- 
data in light gray and a superimposed (darlc line) artifact signal (f-data), which clearly follows 
the low-fi-equency trends. Figure 3b shows the residual signal (g-data) for this example, as 
having little low-frequency component while retaining the higher frequency information. 

In one embodiment, eyelid movement, or eye blinks are detected and analyzed to 
monitor alertness and detect drow^ness or fatigue. Changes in eye blink sudi as frequency of 
blinks, and more espedally changes in the period when the eye is closed may be interpreted as 
indicators of fatigue or drowsiness. 

Eye-blink artifact can be recognized as a triangular waveform present in channel S and 
13 using the bipolar montage. The triangular waveform for eye-blink has a duration of about 
0.2 seconds. The eye-blink artifact normally occurs as multiple events where the time period 
between blinks is on the order of one second. The eye-blink artifact can be detected u^g a 
finite-impulse response (FIR) digital filter that has been tuned to detect the eye-blink 
waveform. The peak output of the eye-blink FIR corresponds to the center of the eye-blink 
waveform. 

In other embodiments, other artifacts such as yawns and other movements of the head, 
jaw, or eyes may be detected and used, instead of or in conjunction with, eye blink artifacts to 
indicate alertness or absence of alertness. 

While there has been shown and described what are at present considered the preferred 
embodiments of the invention, it will be obvious to those skilled in the art that various changes 
and modifications can be made therdn whhout departing from the scope of the inventions 
defined by the appended daims. 
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What is dumed is: 
0) 



(2) 



A method for automatically Detracting low-frequency artifacts from brain waves 
comprising the steps of. 

(a) providing at least one channel of raw brain wave data, caUed c-data. selected 
from the group consisting of electroencephalogram data and 
magnetoencephalogram data; and 

(b) separating artifiict data, called f-data, from the e-data whUe preventing phase 
distortions in the data, by passing the eniata through a zero-phase quadratic 
filter which provides an output off-data, whereby the f-data may be&rther 
analyzed to detect alertness. 

Tht method as described in Qaiml wherein said zero-phase quadratic filter comprises 
a first equation that takes the form 

Fi-F(ti) = a,(ti-te)^ + aj(ti-g + a3-a,Ti^ + aiTi + a3; 

wherein = C At is the time at the central point, and Tj = tj - tc ; this 
approximation is fitted to the data, by minimizing the sum of squares of the differences 
between the quadratic equation, F(t). and the raw electroencephalogram data. e(t). 
corresponding to the minimum in the fiinction represented by a second equation 

L = S[F(tO-e(ti)r = Sl(a,T,^ + a,T, + a3)-e,J^ ; 



theminimumm Lisfound from the conditionaL/aak^O. for k= (1,2, 3}. 
forming three simultaneous Unear equations in three unknowns; ti.e window-averaged 
artifiwst (Fe) is given by the fitted value of the central point, F^ = F(0) = H *e 
sums over odd powers of Tj are zero and symmetric sums over even powers of Ti 
(over i from -n to +n) can be converted to sums from 1 to n with = i At, yielding a 
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window-averaged solution for the artifect signal which is represented by a third 
equation 

3 ( 3n^ + 3n -IX ^ e^J - 15 J 

F, : 

(4xi^ + 4n-3)(2n+l) 

(3) The method described in Claim 2 wherein, the sums initially computed from the third 
equation in Claim 2 are further computed using the equations 



n n 



n n n 

S i Cj^i * n e^j + (n + 1) + S i -S , am 

S e^^, = e^, - (n + 1)^ + S e^^- 2 s"i e^c +S V^; 



to yield an artifact dataset that contains the f-data. 

(4) Apparatus for automatically extracting low-frequency artifacts from brain waves 
comprising: 

(a) data provi^on means for providing at least one channel of the subject's raw 
brain wave data, called e-data, selected from the group consisting of 
electroencephalogram data and magnetoencephalogram data; and 

(b) separation means for separating artifact data, called f-data, from the e-data 
while preventing phase distortions in the data, said separation means 

8ll»TnillEflKr(|llilE2ID 
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comprising a zero-phase quadratic filter providing an output off-data, said 
separation means communicably connected to said data provision means, 
wherry the f-data may be further analyzed to detect alertness. 

(5) The apparatus as described in Claim 4 wherein the data is fit to a first equation that 
takes the form 

Fi = F(tJ = a,(ti-g^ + a,(ti-g + a3 = a, Ti^ + a^Ti + aj; 

wherein te=C At is the time at the central point, and Ti = ti-te ; this 
approximation is fitted to the data, by minimizing the sum of squares of the differences 
between the quadratic equation. F(t). and the raw electroencephalogram data, e(t), 
corresponding to the minimum in the fiinction represented by a second equation 



L = S [F(ti) - e(ti)P = S [(a, T^^ + a, + a,) - ; 



SI 



the minimum in L is found fi:t>m the condition 91793^ = 0, for k = { 1 , 2, 3 } , 
foiming three simultaneous linear equations in three unknowns; the window-averaged 
artifact (FJ is given by the fitted value of the central point, = F(0) = aj; the 
sums over odd powers of Tj are zero and symmetric sums over even powers of Ti 
(over i from -n to +n) can be converted to sums from 1 to n with Tj = i At yielding 
window-averaged solution for the artifact signal which is represented by a third 



a 

equation 



3 ( 3n^ + 3n -IX Si - 15 (Si i' J 

Fc = 

(4n' + 4n-3)(2n+l) 
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(6) The apparatus described in Claim S lA^erein the sums initially computed from the third 
equation in Claun S are further computed using the equations 

n a 



n n n 

Sici^, =nec+„^, + (n + l)e« + Siei^-Sei^ ,and 
S ? ej^, = e^, - (n + 1 )^ + £ ? e^^- 2 s"i e^^ +S e^^ 

i= -n is 4 i= -o is -n 

to yield an artifiul dataset that contains the f-data. 

(7) A zero-phase fiker for separatuig artifact brain wave data from raw brain wave data 
selected from the group consisting of electroencephalogram data and 
magnetoencephalogram data comprising a zero-phase quadratic filter wherein the data 
is fit to a first equation that takes the form 

F, = F(ti) = a,(ti.g^ + a,(ti.g + a3 = a,Ti^ + a,Ti + a3; 

wherein = C At is the time at the central point, and = tj - ; this 

approximation is fitted to the data, by minimizing the sum of squares of the differences 
between the quadratic equation, F(t), and the raw electroencephalogram data, e(t), 
corresponding to the minimum in the function represented by a second equation 

c+n D 

L = S [F(ti) - c(t,)f = S [(a, T,^ + a, + a,) - ; 

the minimum in L is found from the condition dUdi^ = 0, for k = { 1 , 2, 3 } , 
forming three simultaneous linear equations in three unknowns; the window-averaged 
artifact (F J is given by the fitted value of the central point. = F(0) = 83; the 
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sums over odd powers of Tj are zero and synunetric sums over even powers of Tj 
(over i from -n to +n) can be converted to sums from I to n with Tj = 1 At yielding 
idow-averaged solution for the artifact signal which is represented by a third 



(8) 



wini 
equation 

3 ( Sn^ + 3n -IX S| Chc) - 15 (Si CiJ 

F= ^ ;and 

(4n^ + 4n-3)(2n+l) 

the filter is embodied in a programmed int^ed circuit semiconductor chip. 

The zero-phase filter described in Claim 7 wherein the sums initiafly computed from 
the third equation in Claim 7 are further computed using the equations 



'i+c+l - i=^, i--o 



I»"0 



to 



yield an artifact dataset that contains the artifact brain wave data. 
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